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Abstract. In this work we study the stochastic recursive control problem, in which the 
aggregator (or called generator) of the backward stochastic differential equation describing the 
running cost is continuous but not necessarily Lipschitz with respect to the first unknown vari¬ 
able and the control, and monotonic with respect to the first unknown variable. The dynamic 
programming principle and the connection between the value function and the viscosity solution 
of the associated Hamilton-Jacobi-Bellman equation are established in this setting by the gen¬ 
eralized comparison theorem of backward stochastic differential equations and the stability of 
viscosity solutions. Finally we take the control problem of continuous-time Epstein-Zin utility 
with non-Lipschitz aggregator as an example to demonstrate the application of our study. 
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1 Introduction 

The stochastic control theory arose along with the birth of stochastic analysis and de¬ 
veloped fast in the last few decades due to its wide applications. Indeed the stochastic 
control system is a natural and effective way to involve the uncertainty, disturbance and 
ambiguity appearing in the real-world control problems. Its powerful feature is especially 
embodied in the mathematical finance problems as we study the pricing of contingent 
claim and the optimal strategy in the stochastic financial models, which on the contrary 
promotes the development of stochastic control theory. 

In the development of stochastic control theory, the backward stochastic differential 
equation (BSDE for short) plays a big role. First of all, linear BSDE itself originated from 
the study of maximum principle for a stochastic control problem in Bismut |2] (1973), 
where it appears as the adjoint equation, and later the application of this pioneer work to 
mathematical finance was presented by Bismut [3] (1975). The maximum principle reveals 
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that the optimal solution of a stochastic control problem can be depicted by the stochastic 
Hamiltonian system which is actually a forward-backward stochastic differential equation 
(FBSDE for short). Furthermore, when the stochastic control system is observed partially 
or the state equation itself is a stochastic partial differential equation, the adjoint equation 
in this case is a backward stochastic partial differential equation, which was indicated in 
Bensoussan n (1983). The maximum principle for stochastic control system with the 
diffusion term dependent on control and the control regions not necessarily convex was 
another mile of stone in stochastic control theory, which was solved in Peng [22] (1990) 
by using the second-order matrix-valued BSDE to serve as the adjoint equation. We 
recommend the reader to refer to the monograph [29] (1999) by Yong and Zhou, in which 
comprehensive introductions to the stochastic control theories are presented. 

The role of BSDE in stochastic control theory is not only restricted to the maximum 
principle as an adjoint equation. The nonlinear BSDE has even greater influences in 
the stochastic recursive utilities and their associated control problems, thanks to the 
importance of recursive utilities in modern mathematical finance. The existence and 
uniqueness of adapted solution to nonlinear BSDE in mathematics was proved by Pardoux 
and Peng [20] (1990). Later Duffie and Epstein [8] (1992) put forward the concept of 
stochastic differential utility in a conditional expectation form which is equivalent to the 
nonlinear BSDE. Since then both BSDEs and stochastic control problems in mathematical 
finance achieved a great progress benefiting from their connections. The reader can refer 
to El Karoui, Peng and Quenez [9] (1997) which concluded early works on BSDEs and 
their applications to mathematical finance. 

The stochastic recursive control problem we concern with was introduced by Peng [24] 
(1992). Its state equation is a stochastic differential equation (SDE for short): 

r,X t r ' x ’ v ,v r )dr + J a(r, X^ v ,v r )dB r for x E R". (1. 

The cost functional is associated with the solution to a BSDE on the interval [t, T] coupled 
with the state process: 


Xl’ x ’ v = x + / b( 


Y l' x ' v = h{X^ v ) + / f(r, X i r ’ x ’ v , Y?’ x ’ v , Zt’ x ’ v , v r )dr 


7t,x:v 


dB r 


( 1 . 2 ) 


and defined as below 

J{ti x] v) = Yt’ x ’ v , (1.3) 

where v is an admissible control process in the admissible control set U. The correspond¬ 
ing control problem is to find an optimal v Eld to maximize the cost functional (11. 3p for 
given (t, x). As you can see, FBSDE arises again to depict this recursive control system. 
Actually, as a popular equation, FBSDEs appear in numerous control and related math¬ 
ematical finance problems. For the theories and applications of FBSDEs, we recommend 
the reader to refer to e.g. Ma, Protter and Yong [T7] (1994), Peng and Wu [26] (1999), 
Yong [28] (2010) or the classical book [18] (1999) by Ma and Yong. 

For this stochastic recursive control system (jl.ip - fll.3p . Peng [[24] established the dy¬ 
namic programming principle in the Lipschitz setting of the aggregator (or called generator 
from BSDE point of view) and connected its value function with the Hamilton-Jacobi- 
Bellman (HJB for short) equation. Since the recursive utility can be regarded as the 


2 






solution of BSDE (11.2ft with the conditional expectation form, the stochastic recursive 
control system in form includes the control problem related to stochastic (recursive) dif¬ 
ferential utilities 

V t = E*'[f f(c s ,V s )ds ], (1.4) 

where c is the consumption process serving as the control. It is well known that the recur¬ 
sive utility is an extension of the time-additive expected utility. In comparison with the 
latter, the former’s risk aversion and intertemporal substitutability are separated in the 
aggregator which is “useful in clarifying the determinants of asset prices and presumably 
for a number of other issues in capital theory and finance” (see 0 )- 

In our study we aim to relax the Lipschitz restriction to the aggregator, i.e. the aggre¬ 
gator /(c, u) in (jl .4(1 is continuous but not necessarily Lipschitz with respect to both the 
utility variable u and the consumption variable c, moreover, it is of polynomial growth 
with respect to u in our assumptions. These settings would make much difference in the 
deduction of the dynamic programming principle and bring much trouble in the verifi¬ 
cation of conditions for the stability of viscosity solutions which leads to the connection 
between the value function and the viscosity solution of the associated HJB equation. 
Although there are some further results on stochastic recursive control problem from the 
dynamic programming principle point of view, such as Peng |25] (1997) for non-Markovian 
framework, Buckdahn and Li [ 6 ] (2008) for stochastic differential games, Wu and Yu [27] 
(2008) for the cost functional generated by reflected BSDE, Li and Peng [16] (2009) for 
the cost functional generated by BSDE with jumps, Chen and Wu [7] (2012) for the 
state equation with delay, etc., as far as we know there are no existing results in the 
non-Lipschitz aggregator setting. However, back to the stochastic recursive utilities, the 
aggregators in many situations are not Lipschitz with respect to the utilities and con¬ 
sumptions. For instance, the aggregator of the well-known continuous-time Epstein-Zin 
utility has a form 




-t) 4(—- C i ) x *-i 

1 p ((1 — l) u ) 1-7 


(1.5) 


where 5 > 0 is the rate of time preference, 0 < 7 7 ^ 1 is the coefficient of relative risk 
aversion and 0 < i/j 7 ^ 1 is the elasticity of intertemporal substitution. In general, the 
aggregator /(c, u) in (11.5jl is not Lipschitz with respect to c and u but could be monotonic 
with respect to the latter by suitable choices of parameters. We notice that a remarkable 
process for stochastic recursive control problem with non-Lipschitz aggregator had been 
made by Kraft, Seifried and Steffensen [13], in which the verification theorem is proved 
for the non-Lipschitz Epstein-Zin aggregator and explicit solutions to HJB equation are 
given in some cases. Nevertheless, the dynamic programming principle for non-Lipschitz 
stochastic recursive control system is still not involved. 

Certainly, one important technique to study stochastic recursive control problem in 
the non-Lipschitz setting is how to deal with the BSDE with non-Lipschitz aggregator. 
There is much literature devoting to the relaxation of Lipschitz condition of the aggregator 
f(t , y, z ) with respect to the first unknown variable y and/or the second unknown variable 
z, such as Lepeltier and San Martin [15] (1997) for linear growth condition of y and z, 
Kobylanski [14] (2000) for quadratic growth condition of z, Briand and Carmona [4] 
(2000) for polynomial growth condition of y and Pardoux [19] (1999) for arbitrary growth 
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condition of y, to name but a few. As for the monotonic condition of y it was first 
introduced to BSDE theory by Peng [23] (1991) for the infinite horizon BSDE. After 
that many works adopted the monotonic condition to weaken the Lipschitz assumption 
or make BSDE more applicable to the related fields, including e.g. Hu and Peng H2 
(1995), Pardoux and Tang [2T] (1999), Briand, Delyon, Hu, Pardoux and Stoica [5] (2003), 
besides [4], [19] and [26] mentioned above. However, to our best knowledge there are no 
existing results about the dynamic programming principle and associated HJB equation 
for a stochastic control system involving nonlinear BSDE with the monotonic or other 
non-Lipschitz aggregators. 

This paper generalizes the results in [24] by studying a stochastic recursive control 
problem where the cost functional generated by BSDE with the non-Lipschitz but contin¬ 
uous and monotonic aggregator. We first establish the dynamic programming principle 
with the helps of the backward semigroups and generalized comparison theorem in non- 
Lipschitz setting, and then connect the value function of our concerned control problem 
with a viscosity solution of the corresponding HJB equation by means of stability of vis¬ 
cosity solution. Needless to say, the relaxation of Lipschitz condition makes our control 
problem applicable to more mathematical finance models, including the continuous-time 
Epstein-Zin utility with non-Lipschitz aggregator. 

The rest of this paper is organized as follows. In Section 2, some useful notation is 
introduced and the necessary preliminaries are clarified. Then we deduce the dynamic 
programming principle in a non-Lipschitz aggregator setting in Section 3. In Section 4 
we establish the relationship between the value function of the control problem and the 
viscosity solution of the corresponding HJB equation provided that the aggregator of 
BSDE independent of the second unknown variable. Finally, an example from the control 
problem of continuous-time Epstein-Zin utilities is given in Section 5 to demonstrate the 
application of our work to mathematical finance. 

2 Notation and preliminaries 

Given a complete probability space (D, P), let (B S ) 0 < S < T be a d-dimensional Brownian 

motion on the probability space. Denote by {^ s )o<s<t the nature filtration generated by 
(B s ) o< s <t with containing all P-null sets of &. We use | • | and (•, •) throughout the 

paper to denote the Euclidean norm and dotproduct, respectively, and then we define 
some useful notation. 

Definition 2.1. For q > 1, 0 < t < T, we denote by 

• L 2q (Vt, R n ): the space of all -measurable random variables £ : 12 —> R n satis¬ 
fying E[\£\ 2q ] < oo; 

• S 2q (t, T; R ri ): the space of all joint measurable processes p : [£, T] xfl —> R n satisfying 

(i) p s is & s -adapted measurable and p s is a.s. continuous for t < s < T, 

(ii) E[ sup |^(s)| 2,J ] < oo; 

se[t,T} 

• M 2q (t, T; R n ): the space of all joint measurable processes ip : [t, T] x —)■ R n 

satisfying 

(i) p s is & s -adapted measurable for t < s < T, 
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(ii) E[f t T |v?(s)| 2 g rfs] < oo. 

Next we clarify the set of admissible control processes U in the control system (II.II) - 
(II.3p which is defined as below: 

U = {n| v G M 2 (0, T; R m ) and takes values in a compact set U C R m }. 

We assume the conditions to the coefficients of state equation ( 11 . 11 ) as follows. 

(HI) Both b(t,x,v ) : [0,T] x R n x U —> R n and a(t,x,v ) : [0, T] x R n x U —> R nxd are 
joint measurable and continuous with respect to t. 

(H2) For any t G [0,T], x,x' G R n , v,v' G U, there exists a constant L > 0 such that 

| b(t, x , v ) — b{t, x ', t/)| + |cr(t, x , v) — a(t, x', t/)| < L(\x — x'\ + \v — n'|). 

A standard argument for SDE with Lipschitz condition leads to the existence and 
uniqueness result to the solution of SDE (II.ip . For the use of the proof for dynamic 
programming principle, we consider a general SDE with a random variable initial value, 
and conclude the existence result, uniqueness result and some useful estimates to its 
solution. 


Proposition 2.2. Assume Conditions (HI)-(H2). Given q > 1, for any t G [0, T], v G U , 
77 G L 2g (Q, M”), the following SDE 

Xl’W = ri + J b(r,X t r ’ rt ’ v ,v r )dr + J cr(r, X*’ v ’ v ,v r )dB r (2.1) 

has a unique strong solution X t,ri ’ v G S 2q (t, T; M n ). 

Moreover, there exists a constant C > 0 depending only on L , T such that for any 
t < s <T, v,v' G hi, rj, r( G L 2q (Q, \ M n ), we have 


E 


sup | Xl™ v \ 2q 

s£[t,T] 


< C(1 + E[\rj\ 2q + 



v r \ 2q dr]) 


and 


E 




sup \Xl™ v - X t /’ v '\ 2q 

se[t,T] 


< C(\rj— rj'\ 2q + 



\v r - v' r f q dr}). 


Then we turn to the assumptions to the coefficients of BSDE (II.2p . 

(H3) Both h(x) : M n —> M" and f(t, x, y , z, v ) : [0, T] x l n x M 1 x x U —> R n are joint 
measurable, and f(t,x,y,z,v ) is continuous with respect to ( t,y,v ). 

(H4) For any t G [0,T], x,x' G R n , y G R 1 , z,z' G R d , v G U, there exists a constant 
A > 0 such that 


I h{x) - h(x') | + | f(t,x,y,z,v) - f(t,x',y,z',v)\ < A(|x - x'\ + \z- z !|). 

(H5) For any t G [0, T], x G R", y, y' G R 1 , z G R d , v G U, there exists a constant /iGR 1 
such that 

('V ~ y') (f(t, x, y , 0 , v) - f(t, x , y', z, v)) < n\y - y ’| 2 . 

(H 6 ) For a given p > 1 and any t G [0, T], x G R n , y G R 1 , z G R d , v G U, there exists a 
constant n > 0 such that 


I f(t,x,y,z,v) - f(t,x,0,z,v)\ < k(1 + \y \ p ). 
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With Conditions (H1)-(H6), the existence and uniqueness of solution of BSDE (11.21) 
is an existing result and we recommend the reader to refer to |19| for details. Also here 
we consider a general BSDE coupled with the solution of SDE (12.ip . and conclude the 
existence result, uniqueness result and some useful estimates to its solution. 

Proposition 2.3. Assume Conditions (HI)-(H6). Given q > 1, for any t G [0, T\, v G U, 
rj G L 2q (Ll, APp R n ), the following BSDE 


Yt'W = h(X™ v ) + / f(r,X t r ' r r’ v ,Y?> r r’ v ,Z t r ' rr ’ v ,v r )dr- Z^ v dB r ( 2 . 2 ) 


has a unique solution (Y t,v ' v , Z t,v ’ v ) G S 2q (t,T]M}) x Af 2 (f,T;R d ). 

Moreover, there exists a constant C > 0 depending only on L, X, p., k,T such that for 
any t < s <T, v & U, rj,rj' G L 2q (Ll, M n ), we have 


I^T < C(l + \r,\ 2q + E^[J 7 |/(r, 0, 0, 0, v r )\ 2q dr}), 


| Y^ v - Y^' v | < C\rj - rf\ 

and 

E{ sup \Yf^ v \ 2q + [ \Y s t ’ v ’ v \ 2q - 2 \Zl^ v \ 2 ]<C(l +E[\ V \ 2q + f |/(r, 0, 0, 0, v r )\ 2q dr\). 

sG[i,T] Jt Jt 

Remark 2.4. In the proof for Proposition \2. A we substitute the monotonic condition (H5) 
for the global Lipschitz condition in the standard deduction by ltd’s formula to obtain the 
same forms of estimates. As for the L 2q estimates of solutions, q > 1, the common 
localization method is applied in the proof and the reader can refer to e.g. Lemma 3.3 in 

m- 

Just as the classical situation, the comparison theorem of BSDE (II .2)1 is necessary to 
establish the dynamic programming principle, without the exception to the new situation 
that the aggregator satisfies the continuous and monotonic condition rather than the 
Lipschitz condition. For this setting, the following comparison theorem in Fan and Jiang 
[TO] is applicable. 

Theorem 2.5. (Comparison theorem in 11 Of) Let (£, /) and (£', /') be two generators for 
finite horizon BSDEs on [0, T] with the corresponding solutions (y, z) and ( y ’, z') in the 
space S 2 { OjTjM 1 ) x M 2 ( 0 ,T;M d ), respectively. Assume that G L 2 (D, K 1 ) satisfy 

f < £' a.s. and f (resp. f) satisfies the following conditions: 

(Al) f(t,y,z) is weakly monotonic with respect to y, i.e. there exists a nondecreasing 
concave function p : M + —> M + with p( 0 ) = 0 and p(u ) > 0 foru > 0 such that f Q+ du = 
oo and for any t G [0, T], jq, y 2 G M 1 , z G R d , 

sgn(yi - y 2 ) ■ {f(t, y u z ) - f(t, y 2 , z)) < p(\yi - y 2 1 ) a.s.; 

(A2) there exists a continuous, nondecreasing and linear growth function <f : M + —> R + 
satisfying 0(0) = 0 such that for any t G [0, T\, y G M 1 , z\,z 2 G 

I f(t,y,zi) - f(t,y,z 2 )\ < 0 (|^i - z 2 \) a.s.; 
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(AS) for any te [0 ,T\, f(t,y' t ,z' t ) < f'(t,y' t , z[) (resp. f{t,y t ,z t ) < f'(t,y t , z t )). 
Then we have 

yt < y't for all t G [0, T\ a.s. 


3 Dynamic programming principle with non-Lipschitz aggrega¬ 
tor 


In this section, we prove a generalized dynamic programming for stochastic recursive 
control problem, in which the aggregator / is not necessarily Lipschitz but continuous 
and monotonic. To begin with, we introduce the so-called backward semigroup brought 
forward by Peng in [ 25] . 

For given t G [0,T], t\ G (t,T], x G M n , v G U and -measurable y G L 2 (f2;M 1 ), we 
define 


G t,X',V 
r,ti 


w = % 


t,x;v 


G [t, t\ 


where (Y t,x;v , Z t,x ’ v ) G S 2 (t, tp, R 1 ) x M 2 (f, tp, R d ) is the solution of BSDE on the interval 

[Mi]: 


ctl 


Yf x;v = r; + / / (r, X*’ x;v , Y*’ x;v , Z*’ x;v , v r )dr — / Zf x ' v dB r 


and X t,x ’ v is the solution of SDE (11.ip . 

In view of the uniqueness of solution of BSDE (II,2[) . it yields that 




[h{X, 


t,X]V 


)] = G 


t,X',V 

t,t+5 


KT)- 


On the other hand, back to the control system (11.II) (11,3j) the relevant value function of 
the control problem maximizing the cost functional is defined as below: 


u(t,x) = esssup^g^ J(t, x] v), {t,x) G [0,T] xK n . 


(3.1) 


In fact, u is still deterministic in our non-Lipschitz setting. 

Lemma 3.1. Assume Conditions (H1)-(H6). Then the cost functional u defined in \3.1\) 
is a deterministic function. 

Proof. The idea to prove this lemma was initialed by Peng [25]. But since the absence 
of Lipschitz condition to f(t.,x,y,z,v ) with respect to y and v, some changes should be 
made in the proof. 

To begin with, we denote by t,s)t<s<T the nature filtration generated by ( B s — 
Bt)o< s <T and define two subspaces of U\ 

hC = {v Eli | v s is , s ~ measurable for t < s < T}; 

N 

U l = {w G U\ v s = vjlAi, where v 1 G U l and {Aj}^ =1 is a partition of (fl, J^)}. 

3 =1 

We first prove 

esssup^g^ J(t, x ; v ) = esssup, ug ^ t J(t, x\ v ). (3.2) 
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Noticing U l is a subspace of U , we only need to prove that “<” holds. To see this, 
note that U 1 is dense in U , so for any v G U, there exists a sequence {v n }™ =1 C U H such 
that 



2 ds] = 0. 


Moreover, we can choose a subsequence from {v n }™ =1 , still denoted by {u n }^L 1 without 
loss of any generality, which satisfies 

lim Vg = v s a.s. 

n—t oo 


Applying Ito formula to | Yg ,x ' ,v — Yg ,x ' ,v | 2 , together with the monotonic condition and 
Gronwall’s inequality, we have 



2 dr] 



I f(s, X*™, Yg’ x ' ,v , Z^, <) - f(s, XtT’ v , Y^ v , Z^, v .)f 


(3.3) 


Here and in the rest of this paper C p is a generic constant depending only on given 
parameters and its values may change from line to line, moreover, we use a bracket 
immediately after C p to indicate the parameters it depends on when necessary. 

By (13.3p and Propositions 12.21 it turns out that 


j^^Yt,x;v n _ yt,®p;|2j 

< C P E[ f |u" - v,\ 2 ds] 


(3.4) 


+c r E\ / - f( s ,xi^x^,zi^,v,)\ 2 d s }. 


Noticing Conditions (H3), (H4) and (H6), we know that 


< Cp(l + \Xl’ x ’ v \ 2 + \Y*’ x ’ v \ 2p + IZ^I 2 ), 


which is integrable in L 2 (Q x [£, T];!! 1 ) in view of Propositions 12.21 and 12.31 Thus by the 
dominated control theorem it yields 


lim E\ | f(s,X, 


t,x;v 
s i 


Y c 


t,x;v yt,x;v 
i ^ s i 


l ) — f{s, Xg’ v , Y s 


t,x m ,v \zt,x\v yt,x;v 


,Zl 


S )\ 2 ds] = 0. 


Hence, taking the limits on both sides of (13. 4 p we have 

lim E[\Y?' x ’ vn - Yf ™| 2 ] = 0. 

n—>oo 
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Consequently, there exists a subsequence of {v n }jf =1 , still denoted by {v n }fj =1 without 
loss of any generality, such that 

v \ / rt,X:V n T 7-t,X\V 

lim Y t ’ ’ =Y t a.s. 

n—>-oo 

Due to the definition of cost functionals and the arbitrariness of r G W, we have 

esssup,,^ J{t, x ; v ) < esssup 1)e ^ t J(t, x; u), 

and then (13.21) follows. 

The next step is to prove 

esssup„ e ^t J[t, x ; v ) = esssup^g^ J(f, x; n), (3.5) 

for which the argument is similar to the classical case that f(t,x,y,z,v) satisfies the 
Lipschitz condition with respect to y and v. The reader can refer to [25J or [27J for 
details. 

Therefore, (13.2p and (13.5f) conclude 

esssup^g^ J(t, x; v ) = esssup^g^t J(t, x; v ), 

which implies that u defined in (13.11) is a deterministic function. □ 

With Proposition 12.31 we can also obtain two lemmas related to the value function. In 
fact, their proofs are very similar to the counterparts in [25] . in which the estimates in 
Proposition 12.31 are used but the Lipschitz conditions for f(t,x,y,z,v ) with respect to y 
and v are not needed any more. So we leave out the proofs here. 

The first lemma claims the Lipschitz continuity and linear growth of the value function 
u(t, x) with respect to x. 

Lemma 3.2. For any t G [0,T] ; x,x 7 G there exists a constant C such that 

(i) \u(t, x) — u(t, x')\ < C\x — x'\, 

(ii) \u(t,x)\ < (7(1 + |x|). 

The other lemma connects the cost functional with the solution of BSDE (12.2p . where 
the state is a random variable. 

Lemma 3.3. For any t G [0, T], v G U, rj G L 2 (h2, 2^; M"), we have 

J(t, V ;v) = Y t t 

Moreover, we need the following lemma which plays a big role in the proof of dynamic 
programming principle. 

Lemma 3.4. For any t G [0, T], v G U, rj G L 2 (Q, we have 

u(t, rj) > Y t t,ri,v a.s. (3.6) 

On the other hand, for any e > 0, there exists an admissible control v EU such that 

u(t, rj) < Y t t,r>,v + e a.s. (3.7) 
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Proof. We first prove that Lemma 13.41 holds for any simple random state variable f = 

N 

22 x,lA :j , where N G N, Xj G and {Aj}^ = i is a partition of (Q, & t ). 

3 = 1 

For any since 

N N 

yP" = <Y.u(t.x,)iA, = «(t,o, 

j=i i=i 

(13. 6 p is true for the simple random variables. To prove (13.7p . we notice that for each Xj, 
there exists an admissible control Vj G U* such that 

U{t, Xj) < Yt™ + £. 


N 

Hence taking v = v j^Aj G U we have 

3 = 1 

TV V 

y, W; ” + £= + 

J=1 3 =1 

That is to say that both (13.61) and (13.71) are satished for the simple random state variables. 

For any random state variable rj G L 2 (h2,^;M n ), there exists a sequence of simple 
random variables {C}^Li such that 


lim |Cn - V\ = 0. 

n—>oo 

By Proposition 12.31 and Lemma [3.21 we have for any v G U, 

lim _ y* , v ' v \ — 0 a.s. and lim \u(t, £ n ) — u(t, 77 )| = 0 a.s. 

n—>00 n—>00 


Since Y*^ n ’ v < u(t, ( n ) holds for all n, (13.61) follows for T] as n —* 00 . 

Also (13.7p is true for any random state variable 77 G L 2 (h2, M n ). To demonstrate 
this, we choose a simple random variable £ such that |£ — 77 1 < -fc- I 11 view °f Proposition 
12.31 and Lemma [3.21 again it yields that for any uGh ! , 

\Y^ V ~ Yt' mv \ < - and | u(t, £) - u(t, rj)\ < |. 


Note that since £ is a simple random variable there exists an admissible control v 
such that 


vt,Cx 

1 t 


+ | > u(t, 0- 


G U 


Hence 

Y*'™ > -Iy/’ C;e - Yt™*\ + Y^ > u(t, £) 
which puts an end of proof for Lemma 13.41 


2e 

y 


> u(t,T}) ~£, 


□ 


Now we are well prepared to prove the dynamic programming principle in our settings. 
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Theorem 3.5. (Dynamic programming principle with non-Lipschitz aggrega¬ 
tor) Assume Conditions (H1)-(H6). Then for any 0 < 5 < T — t, the value function 
u(t , x ) has the following property: 

u(t, x ) = esssup„ eW Oi^+s[u(t + S, X^)]. 


Proof. First of all, by the definition of notation and the uniqueness of solution of BSDE 
(ll.2p we have 

u(t, x ) = esssup„ gW Gl’^ v \h(X^ x,v )\ 

= esssup v&A G ftUdtU \ 

= esssup vG u G ti+ 5 [ Y t+ 8 ,Xt+S ’1- 


Then we need use the comparison theorem of BSDE in the next step. Bear in mind that 
the aggregator of BSDE (1 1.2 j) is not Lipschitz with respect to the first unknown variable, 
so the classical comparison theorem does not work. Instead, we apply the generalized 
comparison theorem with “weakly” monotonic aggregator (Theorem I2.5[) to our case. 
But before the application of this generalized comparison theorem we need first show 
that u(s, Xf x ' ,v ) for t < s < T and v Eld is square integrable which acts as the terminal 
value of BSDE. To see this, note that for any e > 0, by Lemma 13.41 there exists v E U 
such that 


so we only need to prove E[\Yf' Xa ' ’ ’ v \ 2 ] < oo. Noticing the uniform boundedness of the 
control processes in U we use Propositions 12.21 and 12.31 to know that 


E{\Y, 


s,X 


t,x;v 


;v 1 2] 


< c r ( 1 + E[\xl*r + yi/(r,0,0.0,« r )| 2 *]) 

< C p (l + £[|x| 2 + J \v r \ 2 dr + J |/(r, 0, 0, 0, fv)| 2 ^ r ]) < oo. 


Hence the application of the Theorem 12.51 together with the definition of the value func¬ 
tion, yields 

u(t, x ) < esssup wgW Gl^ s [u(t + <5, Xffi)]. (3.8) 

On the other hand, according to Lemma 13.41 for arbitrary e, there exists an admissible 
control v Eld such that 


Hence we have 


u(t + 5,X^)<Y- 


i . c- \rt,x:v - 

r t+6,X t ’ + l -,v 


+ £. 


u(t,x) > esssup vGU G t t ’^ s [Y^’ Xt+s ,v ] 

> esssup wgW (%$fs[u{t + 5, Xffi) - e] 

> esssu Pl)gW G^gluit + 5, Xffi)] - v FC v e , 


(3.9) 


(3.10) 


with a constant C p . Here the second inequality in (13.10[) is based on (13. 9 p and the com¬ 
parison theorem, and the last inequality comes from a basic estimate of BSDE. To see 
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this, we set Y t hr = + 5, Xffi)\ and Y?' v = + 5, X^'f) - e]. Applying 

Ito’s formula to e _fcs |Y g 1;i ’ — Y^’ v , : , where t < s < t + 5 and A: > 0 is a sufficiently large 
constant, we have 


\Y^ - Yi 


2;v 1 2 


< C p E^[\u(t + S.xtff) -£-«(< + <5,X,+7)| 2 ] = C p B«[e 2 ]. 


Thus 


\r‘2'.v / /T/'lj'y \/-‘2 m .v\ / iTT-lju t/2;ui / rF~T~ 

esssup weM y t -esssup weM y t < esssup„ eW (y t -E t ) < esssup„ eW |y t -Y t | < V^p £ 

which implies 

esssup„ gW F t 1;t ’ < esssup^g^ y t 2; ” + y/C^e, 


i.e. 


esssup„ ew G^Ki + 5, Xffi)] < esssup„ eW G^[u(f + <5, - e] + sfGpS. 

Therefore, the dynamic programming follows from (13.81) and (13 .1 Of) . due to the arbi¬ 
trariness of £ in (13.1 Op . □ 


4 Viscosity solution of HJB equation 

We aim to establish the connection in this section between the value function of our con¬ 
cerned stochastic recursive control problem and the viscosity solution of its corresponding 
HJB equation. For this, we need to assume that the aggregator of BSDE in our concerned 
recursive control problem is independent of the second unknown variable throughout Sec¬ 
tion 4, i.e. f(t, x, y, z, v) = f(t, x, y, v ) for / in BSDE ((121). 

In this situation the HJB equation, a second-order fully nonlinear PDE of parabolic 
type, has a form: 

{ d 

—u + H(t, x , u, D x u , D 2 r u) = 0, (t, x) G [0, T ) x R n , 

u(T,x) = h(x). (4.1) 

Here D x u and D^u denote the gradient matrix and the Hessian matrix of u, respectively. 
The Hamiltonian H = H(t,x,r,p,A ) : [0,T] x R n x R 1 x K" x —» R 1 is defined as 
below: 

H = sup {-Tr(a(t, x, v)a*(t , x, v)A) + (p, b(t, x, v)) + f(t , x, r, n)}, 

v£U Z 

where S” is the matrix space including all n x n symmetric matrices. 

Denote by C 1,2 ([0, T) x R n ; R 1 ) the space of all functions from [0, T] x R n to R 1 whose 
derivatives up to the first order with respect to time variable and up to the second order 
with respect to state variable are continuous. Then we recall the definition for the viscosity 
solution of HJB equation (14.11) . 

Definition 4.1. A continuous function u : [0,T] x R n — y R 1 is a viscosity subsolution 
(resp. supersolution) of HJB equation (14.11) . if for any x G R n , u(T,x ) < h(x) (resp. 
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u(T, x ) > h(x)), and for any ip G C' 1,2 ([0, T] x R"; R 1 ), (£, x) G [0, T) x R n , ip — u attains 
a global minimum (resp. maximum) at (f, x) and ip satisfies 

d 

—(^(t, x) + #(£, x, ^9, A;V?, Dlp>) > 0 

d 

{resp. ^{t, x) + H(t, x, ip, D x <p, D\pf) < 0). 

We call u the viscosity solution of (14.ip if u is both a viscosity subsolution and a viscosity 
super solution. 


We need some preliminaries to establish the connection. First, we indicate the conti¬ 
nuity of the value function. 

Proposition 4.2. Assume Conditions (H1)-(H6). Then the value function u(t,x ) : 
[0,T] x R n — y R 1 defined in H3.1\) is continuous with respect to (£, x). 

Note that the Lipschitz continuity of u(t,x ) with respect to x is a result of Lemma 
13.21 which is the counterpart of Lemma 5.2 in [25]. Also we can prove the ^-Holder 
continuity of u(t,x) with respect to t in a similar way referring to Proposition 5.5 in 
[25] , which together with Lemma 13.21 implies the continuity of the value function with 
respect to (£,x). There is nothing special for the non-Lipschitz aggregator in our setting 
in comparison with the classical Lipschitz aggregator, so we leave out the proof here. 

Then we define a sequence of smootherized functions f n , n G N, based on the aggre¬ 
gator / as follows: 

fn{t,x,y,v)= (Pn* f(t,x,-,v))(y), (4.2) 

where p n : R 1 —> R + , n G N, is a family of sufficiently smooth functions with the compact 
support in [—, and satisfies 

/ p n (a)da = 1. 

Js . 1 

Consequently, we have a sequence of BSDEs with the smootherized aggregators f n , n G Id, 
on the interval [t, T]: 


Y t, x ,n-,v = h(xff x ' v ) + / f n (r, X*’ x;v , Y* ,x,n;v , v r )dr — / Zf x ^ v dB r 


(4.3) 


With the solutions of BSDEs (14.3|) . we can define a sequence of stochastic recursive control 
problems whose cost functional for each n G N is 

J n (t,x]v) = Y) ,x,n,v for v Eld, t G [0,T], x G R n 


and corresponding control problem is to find an optimal v G U to maximize above cost 
functional for given (£, x). Thus, for each n G N, the value function of control problem 
has a form as 


u n (t,x) = esssup veU J n (t,x]v) for t G [0, T], x G R” (4.4) 

and the Hamiltonian appears like 

H n (t,x,r,p,A ) = sup {\Tr(a(t,x,v)a*(t,x,v)A) + ( p,b(t,x,v )) + f n (t,x,r,v)}, (4.5) 

veu * 
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where (£, x, r, p, A) E [0, T] x 1" x K 1 x K n x E> n . 

Then we prove the uniform convergence of the smootherized aggregators in a compact 
subset of their domain utilizing the continuity of the aggregator. 


Lemma 4.3. Assume Conditions (HS)-(Hf.). 
uniformly in every compact subset of [0, T] x H 


Then f n defined in HTW converges to f, 


x 


x U. 


Proof. Since f Rl p n (a)da = 1, we have 


fn(t,x,y,v ) - f(t,x,y,v ) 


(f(t,x,y 


a,v) - f(t,x,y,v))p n (a)da. 


For any given compact set K C [0, T] x M n x M 1 x U, there exists another compact set 
K such that (t, x,y — a, v) E I\ for any (£, x, y, v ) E K and a E [—1,1]. Notice that since 
f(t, x , y, v ) is continuous with respect to (t, y, v ) and Lipschitz continuous with respect to 
x, we know the continuity and further the uniform continuity of f(t,x,y,v) with respect 
to (t, x, y, v ) in the compact set K. So, for any e > 0, as n is sufficiently large we have 

sup \f n (t,x,y,v) - f(t,x,y,v)\ 

(t,x,y,v)eK 

< sup / \f(t,x,y-a,v) - f(t,x,y,v)\p n (a)da 

(' t,x,y,v)eK J\a\<± 

< £ / p n (a)da 

J\a\< — 

1 1 — n 

= e, 

which implies the desired conclusion. □ 

As a result, we can further get the uniform convergence of the solutions of BSDEs 
with smootherized aggregators in L 2 {fil) space. 

Lemma 4.4. Assume Conditions (H1)-(H6). Then for any v E U, 

lim sup E[\Yt’ x ’ n '’ v -Yt ’ x ’ v | 2 ] = 0, 

n ^°° ( t,x)€K 

where K is an arbitrary compact set in [0,T] x M n , Y t,x ' ,v and Y t,x,n,v are the solutions of 
BSDEs (II.2p and (14.31) . respectively. 

Proof. Firstly, it is obvious that the smootherized aggregator f n satisfies Conditions (H3)- 
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(H 6 ). Hence, applying Ito’s formula to | Y*’ x,n ’ v — Y^ ,x ' ,v \ 2 , we have for any (t, x) E K, 

_ \rt,x;v\2] 


-y; 


<C p E 


\f n {s,Xl’ x ’ v ,Y*’ x ’ v ,v s ) - f(s, X t s ’ x;v , Y*’ x,v , v s )\ 2 ds 


L Jt 


— C p E[ / I f n f I 1{| sup |x*' a!:, ’|>JV}U{ sup |y s *’* ;, '|>iV}} C ^ S ] 

Jt sG[t,T] sG[t,T] 

+ CpE[ I fn «/" 1 2 1 {{ sup |x£* : °|<JV}n{ sup |y s ‘^^|<Ar}}^ s ] 


Then we define 




se[t.T] 


sG[t,T] 

_ i~r 





a -/I 

2 1 

{ sup 

IX*’* 

• V \>N} 

ds] + C p E[ 

/ 1 fn 

-/I 2 l { 

sup 1 

y*’* ; 



sG[t,T] 



It 

s 

e[t,T] 



1 fn~ 

f\\ 

sup 

\xY’ v \ 

<x}n{ sup |y*’* ; ”|<JV}}^ s ]- 






>e[t,T] 


sG[t,T] 






1 fn(s. 

-yt,X\V 
> S 3 

yt,x\ 

1 s 

;V ,Vs) 

- f(s,X 

v -yt,x;v 

3 * s 1 


sup 

|X*’ 3 









se[t,T] 



1 fn(s. 

-yt,x\v 
) 3 

Y l ’ x '- 

s 

‘ V ,V S ) 

- f(s,Xt* 

v 'W't,x;v 

3 1 S ’ 

^)| 2 1 { 

sup 

1 ry 

■^\>N} ds \, 








se[t,T ) 



1 fn(s, 

\rt,x:v 

> 3 

yt,x: 

S 

: > s ) 

- f(s,X 

v -yt,X]V 

3 " s ’ 

Ol" 




Xl {{ 

sup |X*’ 

x; q<iV}n{ sup \Y*’ x ’ v \<N}}d s ], 






sG[t,T] 


sG[t,T] 


and deal with Ji, J 2 and J 3 in turn. 

For J\. it turns out that 

sup J\ 

(t,x)(E.K 

< sup 2B[/ (|/„(»,X^l^,t l .)| J +|/( S ,Xi*”,n‘*”, 0 .)Hl { > m i8\ 

(t,x)£K Jt 


»e[t,T] 


< sup c r E[ (i + iy«’'| 2 + |y, to ”| 2 »)i (sup |x .„ liW) d S ] 

( t,x)GK Jt 

r T 


< sup C p 

(t,x)£K 



s€[t,T ] 
1 


(1 + |X S ^ ;,; | 4 + lY^l^ds})* ( sup P[ sup \Xl’ x ’ v \ > TV]) 5 . 

(t,x)£K sE[t,T] 


To estimate above, we use Chebychev’s inequality and Proposition 12.21 to obtain for any 
iV > 0, 

P[ sup |y««| >N}< ±E{ sup |.Yf ’”| 2 ] < ^\x\ 2 . 

se[t,T] X se[t,T) X- 

Thus for any 6 > 0, it follows from the boundedness of x in K that with a sufficiently 
large N, 

sup P[ sup iXl’^l > N] < 5. (4.6) 

(t,x)£K sE[t,T] 
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Moreover, by Propositions 12.21 and 12.31 we know 


sup (E[ [ (1 + \Xl ’ x ’ v \ 4 + lY^l^ds}) * < oo, 

( t,x)&K Jt 

which together with (14.61) implies that for any given e > 0, there exists a sufficiently large 
N 1 such that as N > N ll for all n£N, 

J\ < £, uniformly in the compact set K. 

Then we turn to J 2 , and by Proposition 12.31 we have 

£[sup \Yf’ x ’ v \ 2p ] < C p (l + \x\ 2v ). 

sG[t,T] 

Again with a sufficiently large N, the application of Chebychev’s inequality in K leads to 
for any 5 > 0, 

sup P[ sup \Y t ’ x ' v \ >N]<5. (4.7) 

(t,x)eK se[t,T] 

Similar to the treatment of J\, by (14.71) we can find a sufficiently large N 2 such that as 
N > N 2 , for all n G N, 


J 2 < e, uniformly in the compact set K. 


We take N — N\\J N 2 and use N to prove the uniform convergence of J 3 . 
To this end, notice for any v G U, 


sup J 3 

( t,x)£K 


< E[[ SUp \f n -f\ 2 l 

Jt (t,x)£K 


{{ sup |x*'^|<A}n{ sup 


ds] 


sG[t,T] 


sG[t,T] 


< / sup 

Jt (t,x,y) £ [0,T] x B 7 ^ x [—iV, JV] 


I fn(t,x,y,v) - f(t,x,y,v)\ 2 ds, 


where B'J is the closed ball with the radium N in M n . By the dominated convergence 
theorem and Lemma [4.31 as n is sufficiently large, we have 


J 3 < £, uniformly in the compact set K. 


Therefore, due to the arbitrariness of s, the claim that lim sup E[\Y t 


t,x,n-,v 


-K 


t,x]v 1 2] 


0 follows, which puts an end of proof. 


’ ( t,x)£K 


□ 


The uniform convergence in compact subset of domain holds for the value function as 
well, which is displayed in next lemma. 

Lemma 4.5. Assume Conditions (HI)-(H6). Then u n converges to u, uniformly in every 
compact subset of [0, T] x M n . 
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Proof. Given arbitrary e > 0, for any t G [0, T] and x G W 1 , we can find v± G U such that 

u(t, x) < Y t t,x,vi + e. 

So 


u(t, x ) — u n (t , x) = w(£, x) — sup Yf’ x,n,v < Yf’ x,Vl + e — Yf 

veU 

On the other hand, for above e, there exists G U such that 


(4.8) 


u n (t,x ) < y, 


t,x,n-,v 2 


+ G 


— e. 


(4.9) 


which implies 

u(*, x) - u n (t, x) > u(t, x) - Y^ m -e> Y^ X ’ V2 - Y t 
Since (I4.8ji and 04.9p . we have 

\u(t,x) - u n (t,x )| < E[\Y{’ X ’ V1 - Yt' x ' n ' m \] + E[\Y^ V2 - Y^ n ’ V2 \] + 2e. 

Noticing v\ and are given admissible controls, by Lemma [4.41 we know that for any 
compact set K C [0, T] x M n , 

lim sup E[\Y}' X ' V1 - F/’™|] + E[\Y t ^ V2 - Y*’ x ’ n ’ V2 \] = 0. 

n ^' 00 ( t,x)eK 

Due to the arbitrariness of e, we obtain the uniform convergence of the value functions 
u n to u in K. □ 

We have known that f n converges uniformly to / in the compact subset of their domain, 
so, by definition of the Hamiltonian, it comes without a surprise that the same kind of 
convergence of the Hamiltonian H n to H holds as well. 

Lemma 4.6. Assume Conditions (H1)-(H6). Then H n converges to H, uniformly in 
every compact subset of their domain. 

Proof. To see this, for any t G [0, T], x G M n , r G M 1 , p G A G § n , v G U, we set 


and 


Noticing 


A = -Tr(a(t, x, v)a*(t, x, v)A) + (p, b(t, x, v)) + f n (t , x, r, v) 


B = -Tr(a(t, x, v)a*(t, x, v)A) + (p, b(t, x, n)) + f(t, x, r, v). 


and 


we have 


H n — H = sup A — sup B < sup(>4 - B) = sup(/ n - /) < sup \f n - f\ 

v&J veu veu veil veu 


H — H n — sup B - sup A < sup (B - A) = sup(/ - f n ) < sup \f - f n \, 

v€.U v€.U v€.U v€.U v€.U 


\H n — H\ < sup | f n (t, x, r, v ) - f(t, x, r, v ) 
veu 
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Note that for any compact set K c [0, T] x R n x K 1 x R" x §" and (t, x, r,p, A, v ) G 
K x U, (t,x,r,v) G K, where K is a compact set in [0,T] x 1" x I 1 x [/. Hence by 
Lemma [4.31 we have 


lim 


sup 

\H n (t, x, r,p, A) - 

H(t, x, r. 

,P,A) | 

n—too 

(t,: 

r,r,p,A)£K 




lim 


sup 

sup I fn{t,X. 

,r,v)~ 

- f(t,x,r, 

u)| 

n—too 

(t,: 

r ,r,p,A)£K v&U 




lim 


sup 

1 fn{t,x,y,v) 

~ f(t, 

II 

= 0. 

n—too 

(t,: 

r,y,v)(E:K 




Therefore, the uniform convergence of H n to H in K follows from above. □ 


To end the preliminaries, we introduce the stability property of viscosity solutions 
below (see e.g. Lemma 6.2 in Fleming and Soner HU for details of proof) which provides 
a method based on the uniform convergence of Hamiltonians to get the connection between 
the value function and the solution of HJB equation. 

Proposition 4.7. (Stability) Let u n be a viscosity subsolution (resp. supersolution) to 
the following PDE 


—u n (t, x) + H n (t, x, u n (t, x), D x u n (t , x), D 2 x u n (t, x)) 
ot 


0, (t, x) G [0, T) x R n , 


where H n (t,x,r,p,A) : [0, T] x 1“ x R 1 x R" x § n 4 l 1 is continuous and satisfies the 
ellipticity condition 


H n (t,x,r,p,X) < H n (t,x,r,p,Y) whenever X < Y. (4-10) 

Assume that H n and u n converge to H and u, respectively, uniformly in every compact 
subset of their own domains. Then u is a viscosity subsolution (resp. supersolution) of 
the limit equation 

d 

— u (t, x) + H(t, x, u(t, x), D x u(t, x), D 2 u(t , x)) = 0. 

Now we are well prepared to prove the main theorem in this section. 

Theorem 4.8. Assume Conditions (H1)-(H6). Then u defined in (13.ip is a viscosity 
solution of HJB equation (14.ip . 

Proof. We divide our proof into two steps. 

Step 1. Assume that |/(£, x, 0, u)| is uniformly bounded for any (£, x, v) G [0, T]xR n x 
U. 

Note that the uniform boundedness of |/(f,x,0,u)| implies the global Lipschitz of 
f n (t, x, y, v ) with respect to y. To see this, for any (£, x, v) G [0, T] x R" x U, yi,y 2 G R 1 , 
by (H6) it yields that 

\fn(t, x, yi, v) - f n (t,x,y 2 ,v)\ 

= 1/ f{t,x,a,v)(p n (y 1 - a) - p n (y 2 - a))da\ 

J\a\<— 

1 1 — n 
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< 

max 

\f(t,x,a,v)\ \p n (yi- 

a ) - Pn(y 2 - a)\da 


a€[— — 

L n ’ n ■ 

1 ■'M<£ 


< 

max 

| {\f{t,x,0,v)\ + «(1 + a p )] 

) 1 C p (n)\yi-i 


a£[— — i —' 

L n 1 n ■ 


< 

C p (k, n 

)\yi ~V 2 \- 



Hence we immediately know from Theorem 7.3 in |25| that u n (t, x ) is the viscosity solution 
of the following equations: 


d 

~Q^ U n %•> 15 Dx'U'm O5 5 %) ^ [0? -^0 ^ 

u n (T,x) = h(x), 


(4.11) 


where u n and H n dehned in (I4.4j) and (14.51) . respectively. 

By Lemmas 14.3114.61 the uniform convergence of f n to /, Y t t,x ’ n,v to Y t t,x,v , u n to u and 
H n to H holds in every compact subset of their own domains as n —> oo. Moreover, H n 
satisfies the cllipticity condition (14.101) . Therefore, by the stability of viscosity solution 
stated in Proposition 14.71 we know that u is a viscosity solution of the limit equation 

d 

— u(f, x) + H(t, x, u(t, x), D x u(t, x), Dlu(t, x)) = 0. 

As for the terminal value of above equation, i.e. u(T,x ) = h(x), which can be seen from 
the definition of the value function. Thereby u is a solution of HJB equation (14.1)1 . 

Step 2. \f(t,x,0,v)\ is not necessary to be uniformly bounded for any (t,x,v) G 

[0,T]xrx u. 

We construct a sequence of functions 


fm(t,x,y,v) = f(t,x,y,v ) - f(t,x,0,v) + U m (f(t,x,0,v)) for m G N, 
where Il m {x) = 


hi 


-x. 


With these f m , we get a family of BSDEs for m 6 N on the interval [t, T]\ 

r T r T 

Y t,x,m-,v = h ( X tWj + / f m ( s ^ x t,x-,v^ Y t,x,m-,v^ v ^ ds _ ^ x ' m ' v dB s . 

Jt Jt 

Similarly we define the corresponding cost functional 

J m (t,x]v) = Yt ' x,m,v for v G U, f G [0,T], x G M 1 , 
the value function 

u m (t,x ) = esssup veU J m (t,x;v) for t G [0, T], x G M 1 , 
and the Hamiltonian 

H m (t,x,r,p,A ) = sup{l i Tr(a(t,x,v)a*(t,x,v)A ) + ( p,b(t,x,v )) + f m (t,x,r,v)} 
veu 2 
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for (t, x , r, p, A) G [0, T] x K" x K 1 x 1" x § n . 

Since f m (t,x,0,v) = f m (t,x,0,v) is uniformly bounded. Moreover, 

it is not difficult to verify that f m satisfies Conditions (H3)-(H6). Hence f m satisfies the 
conditions in Step 1. By Step 1 we know that u m is a viscosity solution of the following 
equation 

{ d 

-^Uyn T H m (t , x, u mj D x u m , D x u m ) 0, (£, x ) G [0, X) x R , 

u m (T,x) = h(x). (4.12) 

We then prove that the uniform convergence of f m to /, Y 1 t,x ’ m ’ v to Y^’ x ’ v , u m to u and 
H m to H also holds in every compact subset of their own domains as m —X oo, among 
which only the proof for the convergence of f m to / is very different from Lemma 4.3 due 
to the different definitions of f m from f n and other convergence can be proved similarly 
according to Lemmas 4.4-4.6 in turn. 

In fact, the uniform convergence of f m to / in every compact subset of [0,T] x R n x 
R 1 x U is easy to see if we notice that for any given compact set K C [0,T]xR n xR 1 x[/, 
f(t, x, y, v ) is bounded by a positive integer Mk for any (t, x, y, v ) G K since the continuity 
of /. Hence, when m > Mk 

sup \fm(t,x,y,v) - f(t,x,y,v)\ 

(t,x,y,v)£K 

= sup |/(f, x, 0, v) — n m (/(f, x, 0, v)) | = 0, 

(t,x,y,v)eK 

which implies the uniform convergence of f m to / in every compact subset of their domain 
as m —> oo. 

Finally, using Proposition 4.7 again we know that u satisfies the limit equation of 
(14.12)1 . which together with the fact u(T,x ) = h(x) in view of the definition of value 
function shows that u is still a solution of HJB equation (14.ip even if | f(t, x, 0, u)| is not 
necessary to be uniformly bounded for any (t, x, v) G [0, T] x R n x U. □ 


5 Example 


As mentioned in Introduction, Duffie and Epstein [8j presented the stochastic differential 
formulation of recursive utility which can be regarded as the solution of a BSDE. Based 
on this basic correspondence, we give an example to demonstrate the application of our 
study to utility. 

We start from setting an financial market with two assets which can be traded con¬ 
tinuously. One is the bond, a non-risky asset, whose price process Xf is governed by the 
ordinary differential equation 

P t ° = 1+ [ r s P°ds. (5.1) 

Jo 

The other asset is the stock, a risky asset, whose price process Pt is modeled by the linear 


SDE 


Pt = P + / P s b s ds + 


P s cr s dB s , 


where p > 0 is given. 


(5.2) 
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In (15.11) and (15.2ft . r : [0,T] —> M 1 is the interest rate of the bond, b : [0,T] — y R 1 is the 
appreciation rate of the stock and a : [0, T] —y M 1 is the volatility process, all of which 
are continuous functions. 

A small agent whose actions cannot affect market prices may decide at time t G [0, T] 
what proportion of the wealth to invest in the stock. Denote the proportion and the 
wealth by 7 r : D x [0, T] —* [—1,1] and X : D x [0, T] —* M 1 , respectively, then the equation 
which the increment of the wealth satisfies follows immediately: 

f dX t = [r t X t + {b t - r t )7TtX t - c t ]dt + X t n t a t dB t 
\ X 0 = X, (5.3) 


where c : Ox [0,T] —>■ faq, 02], 0 < aq < 02, is a restricted consumption decision and x > 0 
is the initial wealth of the investor. It is clear that (15. 3 p acting as the state equation 
satisfies Conditions (HI) and (H2). 

We assume that the stochastic differential utility preference of the investor is a contin¬ 
uous time Epstein-Zin utility as illustrated in (II.5p and the utility satisfies the following 
BSDE: 


dV, = --A(l - 7 )V, 
V T = h(X T ), 


c t 

((1-7 )V t )^ 



1 


dt + Z t dB t 


(5.4) 


where h : M 1 —y M 1 is a given Lipschitz continuous function. The optimization objective 
of the investor is to maximize his/her utility as below: 


max Vo, 

(7r,c) £U 


where 

U = {( 7 r, c)| (vr, c) : [0, T] x D —* [—1,1] x [ai,a 2 ] is the {J^t} 0 <t<T-adapted process} 
is the admissible control set. 

Certainly, the aggregator of (15.41) does not satisfy the Lipschitz condition with respect 
to the utility and the consumption at all time, but we can find applications of our study 
in non-Lipschitz cases. Notice that Proposition 3.2 in [13] provides four cases in which the 
aggregator is monotonic with respect to the utility. Taking into account the polynomial 
growth condition (H 6 ) with respect to the utility we select two cases as follows for further 
consideration: 


(i) 7 > 1 and ij) > 1 ; 

(ii) 7 < 1 and i/j < 1. 

Then we can End suitable powers of utility such that the aggregator of (15.4ft is continuous 
and monotonic but non-Lipschitz in M 1 with respect to the utility in both cases. As for the 
continuity with respect to the consumption, if cp > 0, both cases are Lipschitz continuous 
obviously. In particular, if a\ =0, only case (i) satisfies the continuous but not Lipschitz 
continuous condition with respect to the consumption. 
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Therefore, for all suitable non-Lipschitz situations which satisfy Conditions (H3)-(H6), 
we can use Theorem 14.81 to know that the value function of the investor is a viscosity 
solution of the following HJB equation: 


max 

( 7 r,c)e[-l,l]x[ai,a 2 ] 


w{T, x ) = h(x). 


x) + [x(r t + 7T (bt - r t )) - cjw x (t, x) + - x 2 n 2 a 2 t w xx {t, x) 


5 


+i— rO--i) w (t, x ) ( 

$ 




1 “. L '((! ~l)w{t,x))^ 


= 0 


(5.5) 
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